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CLAIMS 

1 . A system for distributing connections from clients on an external network 
to a plurality of servers on an internal network, the system comprising: 

a client interface to the external network the client interface being operative 
to receive and send packets to and from a remote client; 

a server interface to the internal network, the server interface being operative 
to receive and send packets to and from a plurality of servers, the plurality of servers 
being operative to establish a connection with the remote client; 

a plurality of predicted responsiveness indicators, each of the plurality of 
predicted response indicators being associated with each of the plurality of servers, 
the predicted responsiveness indicators being operative to predict the response time 
of each of the plurality of servers, the predicted responsiveness indicators also being 
stored within the system in a manner that the predicted responsiveness indicators 
may be accessed; and 

a predicted responsiveness comparator which is operative to access and 
compare the predicted responsiveness indicators and to determine which servers 
from among the plurality of servers is associated with a predicted responsiveness 
indicator which measures a best response time, the predicted responsiveness 
comparator being further operative to select a pointer to a server which has a 
predicted responsiveness that is the best predicted responsiveness among the 
predicted responsiveness of the plurality of servers. 

whereby the server which has a predicted responsiveness which is the best 
predicted responsiveness is selected to handle the next connection from a client. . 

2. A system as recited in claim 1, wherein the predicted responsiveness 
indicators are periodically updated. 
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3. A system as recited in claim 1, wherein the predicted responsiveness 
indicators include the number of connections to each of the plurality of servers. 

4. A system as recited in claim 1, wherein the predicted responsiveness 
indicators includmfie^umber of connections to each of the plurality of servers. 

5. A system as recited in claim 1, wherein the predicted responsiveness 
indicators include the predicted response time of each of the plurality of servers. 

6. A system as recited in claim 1, wherein the predicted responsiveness 
indicators include the predicted response time of each of the plurality of servers and 
wherein the predicted response time is calculated according to the formula: 

PR — NQ^R'fCtcujTent " t age stamp ) 

where PRlis the predicted response time, NC is the number of connections to 
the plwsical machine, R is a measured response time, and f(t culTent - t age 
stamp) i s \ an a gi n S function which is a function of the difference in time 
from tne current time and a time recorded in an age stamp when the last 
response time was measured. 

7. A system as recited in claim 6 wherein the aging function decreases the 
predicted response time as the time since the last predicted response increases. 

8. A systemlas recited in claim 6 wherein R is a function of a plurality of 
measured response timek. 

9. A systeri/asrecited in claim 6 wherein R changes with each new 
measured response time, but is constrained to change by less than a certain 
percentage as a result of the latest measured response time. 

10. A system aslrecited in claim 9 wherein the percentage is less than about 
10%. 1 
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25%. 



50%. 



1 1 . A system as recited in claim 9 wherein the percentage is less than about 



12. A system as recited in claim 9 wherein the percentage is less than about 



13. A method 
machines comprising: 



3f distributing incoming packets among a plurality of physical 



intercepting aq incoming packet and determining a packet source IP address 
and a packet destination IP address for the packet from a header of the packet; 

locating a con lection data structure having entries which match the packet 
source IP address and the packet destination IP address; 

using a connection data structure to determine a selected physical machine to 
which the packet is to be distributed; 



replacing the 
physical machine; and 



packet destination IP address with an IP address of the selected 



adjusting a 
packet destination IP 



checksum in the header of the packet to conform to the replaced 
address 



whereby an indbmm^packet is distributed to a physical machine according to 
a selected physical m;iptfme determined by a connection data structure. 



14. A method 
structure having 
destination IP address 
structure exists and 
connection data struci 



as recited in claim 13 wherein locating a connection data 
entries which match the packet source IP address and the packet 
includes determining whether a predefined connection data 
cribating a new connection data structure if no a predefined 
ure exists. 
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15. A method as recited in claim 14 wherein creating a new connection data 
structure includes determining which of the plurality of physical machines is best 
suited to handle the incoming packet. 

16. A method! as recited in claim 15 wherein determining which of the 
plurality of physical machines is best suited to handle the incoming packet includes 
using a foreign physical association data structure to determine whether the packet 
source address corresponds to a foreign entity which previously connected to a 



previously connected 
previously connected 



physical machine and distributing the incoming packet to the 
physical machine. 



17. Amethoc 
plurality of physical 
using a foreign 
source address 
previously connected 
previously connected 
time interval has not 



18. Amethoc 
plurality of physical 
determining which ph 



as recited in claim 15 wherein determining which of the 
ihachines is best suited to handle the incoming packet includes 
physic al association data structure to determine whether the packet 
corresponds to a foreign entity which previously connected to a 

physical machine and distributing the incoming packet to the 
physical machine if a maximum physical machine association 
been exceeded. 



as recited in claim 15 wherein determining which of the 
Machines is best suited to handle the incoming packet includes 
machine has the best predicted responsiveness. 




19. A method as recited in claim 18 wherein determining which physical 
machine has the best predicted responsiveness includes determining which physical 



machine has the fewes 



number of connections. 



20. A method as recited in claim 18 wherein determining which physical 
machine has the best predicted responsiveness includes determining which physical 



machine has the fewest 
factor assigned to each 



number of connections relative to an individual weighting 
physical machine. 
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21. A method as recited in claim 1 8 wherein determining which physical 
machine has thWestj>redicted responsiveness includes determining which physical 
machine hasti^Dest predicted response time based at least in part on a previously 
measured respon&eitime. 
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